| 1. Identity statement | ||||
| Reference Type | Conference Paper (Conference Proceedings) | |||
| Site | sibgrapi.sid.inpe.br | |||
| Holder Code | ibi 8JMKD3MGPEW34M/46T9EHH | |||
| Identifier | 8JMKD3MGPEW34M/45CTJ95 | |||
| Repository | sid.inpe.br/sibgrapi/2021/09.06.15.14 | |||
| Last Update | 2021:09.06.15.14.47 (UTC) administrator | |||
| Metadata Repository | sid.inpe.br/sibgrapi/2021/09.06.15.14.47 | |||
| Metadata Last Update | 2022:06.14.00.00.28 (UTC) administrator | |||
| DOI | 10.1109/SIBGRAPI54419.2021.00040 | |||
| Citation Key | CoelhoPratSchw:2021:GeApFa | |||
| Title | A generative approach for face mask removal using audio and appearance  | |||
| Format | On-line | |||
| Year | 2021 | |||
| Access Date | 2024, May 06 | |||
| Number of Files | 1 | |||
| Size | 4381 KiB | |||
| 2. Context | ||||
| Author | 1 Coelho, Luiz Eduardo Lima 2 Prates, Raphael Felipe de Carvalho 3 Schwartz, William Robson | |||
| Editor | Paiva, Afonso Menotti, David Baranoski, Gladimir V. G. Proença, Hugo Pedro Junior, Antonio Lopes Apolinario Papa, João Paulo Pagliosa, Paulo dos Santos, Thiago Oliveira e Sá, Asla Medeiros da Silveira, Thiago Lopes Trugillo Brazil, Emilio Vital Ponti, Moacir A. Fernandes, Leandro A. F. Avila, Sandra | |||
| e-Mail Address | luizduducoelho@ufmg.br | |||
| Conference Name | Conference on Graphics, Patterns and Images, 34 (SIBGRAPI) | |||
| Conference Location | Gramado, RS, Brazil (virtual) | |||
| Date | 18-22 Oct. 2021 | |||
| Publisher | IEEE Computer Society | |||
| Publisher City | Los Alamitos | |||
| Book Title | Proceedings | |||
| Tertiary Type | Full Paper | |||
| History (UTC) | 2021-09-06 15:14:47 :: luizduducoelho@ufmg.br -> administrator :: 2022-03-02 00:54:15 :: administrator -> menottid@gmail.com :: 2021 2022-03-02 13:23:42 :: menottid@gmail.com -> administrator :: 2021 2022-06-14 00:00:28 :: administrator -> :: 2021 | |||
| 3. Content and structure | ||||
| Is the master or a copy? | is the master | |||
| Content Stage | completed | |||
| Transferable | 1 | |||
| Version Type | finaldraft | |||
| Keywords | computer vision GAN image inpainting | |||
| Abstract | Since the COVID-19 pandemic, the use of facial masks in public spaces or during people gatherings has become common. Therefore, journalists, reporters, and interviewees frequently use a mask, following the public health measures to contain the pandemic. However, using a mask while speaking or conducting a presentation can be uncomfortable for viewers. Furthermore, the usage of a mask prevents lip reading, which can harm the speech comprehension of people with hearing impairment. Thus, this work aims at artificially removing masks in videos while recovering the lip movements using the audio and uncovered face features. We use the audio to infer the lip movement in a way it matches with the uttered phrase. From the audio, we estimate landmarks representing the mouth structure. Finally, the landmarks (i.e. uncovered and estimated) are the input in a generative adversarial network (GAN) that reconstructs the full face image with the mouth in a correct shape. We present quantitative results in the form of evaluation metrics and qualitative results in the form of visual examples. | |||
| Arrangement 1 | urlib.net > SDLA > Fonds > SIBGRAPI 2021 > A generative approach... | |||
| Arrangement 2 | urlib.net > SDLA > Fonds > Full Index > A generative approach... | |||
| doc Directory Content | access | |||
| source Directory Content | there are no files | |||
| agreement Directory Content |
| |||
| 4. Conditions of access and use | ||||
| data URL | http://urlib.net/ibi/8JMKD3MGPEW34M/45CTJ95 | |||
| zipped data URL | http://urlib.net/zip/8JMKD3MGPEW34M/45CTJ95 | |||
| Language | en | |||
| Target File | SIBGRAPI_65.pdf | |||
| User Group | luizduducoelho@ufmg.br | |||
| Visibility | shown | |||
| Update Permission | not transferred | |||
| 5. Allied materials | ||||
| Mirror Repository | sid.inpe.br/banon/2001/03.30.15.38.24 | |||
| Next Higher Units | 8JMKD3MGPEW34M/45PQ3RS 8JMKD3MGPEW34M/4742MCS | |||
| Citing Item List | sid.inpe.br/sibgrapi/2021/11.12.11.46 5 | |||
| Host Collection | sid.inpe.br/banon/2001/03.30.15.38 | |||
| 6. Notes | ||||
| Empty Fields | affiliation archivingpolicy archivist area callnumber contenttype copyholder copyright creatorhistory descriptionlevel dissemination edition electronicmailaddress group isbn issn label lineage mark nextedition notes numberofvolumes orcid organization pages parameterlist parentrepositories previousedition previouslowerunit progress project readergroup readpermission resumeid rightsholder schedulinginformation secondarydate secondarykey secondarymark secondarytype serieseditor session shorttitle sponsor subject tertiarymark type url volume | |||